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(54) PERIPHERY 
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(57) Abstract 

PURPOSE: To facilitate the 
operation by freely switching the 
display wherein the surroundings 
are fixed and the vehicle moves 
and the display wherein the 
vehicle is fixed and the 
surroundings are turned in a 
monitoring device to display the 
condition surrounding the vehicle 
to allow the correct operation by 
a driver in a garage, a parking lot, 
or the like. 

CONSTITUTION: A plurality of 
laser radar sensor 1 1 as a vehicle 
surroundings detecting means are 
provided on the front and rear 
surfaces, the side surfaces and 
four comer parts of a vehicle 
body, and the output signal of the 
comer sensor 1 1 together with 
the output signal of a wheel 
speed sensor 13 and a steering 
angle sensor 14 is received by an 
image synthesizing device 1 2. In 
this image synthesizing device 1 2, 
the position of the vehicle A is 
detected and estimated based on 
the data on the wheel speed and 
the steering angle, and the image 
indicating condition of the vehicle 
A and the condition B surrounding 
the vehicle is synthesized 
therewith. The display (a) where 
the surroundings are fixed and the 
vehicle A moves in the normal 
condition, and the display (b) 
where the vehicle A is fixed and 
the surroundings are turned in the 
parking lot, etc., are selected for a 
display device 1 8 to make the 
relationship between the vehicle 
A and an obstacle visually 
recognizable. 
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(54) PERIPHERY MONITORING DEVICE FOR VEHICLE 
(57)Abstract: 

PURPOSE: To facilitate the operation by freely switching the display 
wherein the surroundings are fixed and the vehicle moves and the 
display wherein the vehicle is fixed and the surroundings are turned in 
a monitoring device to display the condition surrounding the vehicle to 
allow the correct operation by a driver in a garage, a parking lot, or the 
like. 

CONSTITUTION: A plurality of laser radar sensor 1 1 as a vehicle 
surroundings detecting means are provided on the front and rear 
surfaces, the side surfaces and four comer parts of a vehicle body, 
and the output signal of the comer sensor 1 1 together with the output 
signal of a wheel speed sensor 13 and a steering angle sensor 14 is 
received by an image synthesizing device 12. In this image 
synthesizing device 12, the position of the vehicle A is detected and 
estimated based on the data on the wheel speed and the steering 

angle, and the image indicating condition of the vehicle A and the condition B surrounding the vehicle is 
synthesized therewith. The display (a) where the surroundings are fixed and the vehicle A moves in the 
normal condition, and the display (b) where the vehicle A is fixed and the surroundings are turned in the 
parking lot, etc., are selected for a display deyice 18 to make the relationship between the vehicle A and an 
obstacle visually recognizable. 
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DETAILED DESCRIPTION 



Petailed Description of the Invention] 
[0001] 

[Industrial Application] In a car bam, a motor pool, etc., by making display offer of the situation of the perimeter of a 
car intelligibly for an operator, an operator can grasp a perimeter situation easily and this invention relates to the 
perimeter monitoring device for cars which enabled it to perform actuation with an exact operator. 
[0002] 

[Description of the Prior Art] As a conventional perimeter monitoring device for cars, a perimeter is photoed to the 1st 
with two^orlmo^ which was indicated by each official report of JP,62-157642,U or JP,3- 

99952, A, the image of each camera is changed and there is a thing which displays by using the situation of the 
perimeter of a car as one image. Or he measures distance with a perimeter body with an ultrasonic sensor etc., and is 
trying to tell an operator a perimeter situation, especially the access situation to the obstruction of car four comers with 
a flash, an alarm tone, etc. of a lamp as the 2nd again by what was indicated by JP,60-152969,A. Furthermore, as the 
3rd, it installs in the upper part of a parking field, or back instead of attaching a camera in a car, and the equipment 
which displays the image on a car by means of communications in delivery and the vehicle interior of a room is 
indicated by JP,3-3589,A and JP,4-123945,A each official report. 
[0003] 

[Problem(s) to be Solved by the Invention] However, it is hard to have the sensation that the self-car is moving by the 
1st thing to the operator among such conventional perimeter monitoring devices for cars since it is the display to which 
the self-car was fixed in compounding the image picturized with the camera attached in the self-car, and displaying on 
a display in the car, and the relative relation between a self-car and a perimeter situation is a pile to a grip. Moreover, a 
lamp and the thing to tell to a sound have the problem that a concrete distance of a car obstmction is unclear, by the 
2nd ultrasonic sensor etc. detecting a perimeter situation. 

[0004] And although the display to which af€aigii^a|i)Sfflnstdfed gab@^e^^^ parking field, the image is displayed on in the 
car by means of communications, and a self-car moves by the 3rd thing in that case is performed, in being able to use 
only in the location in which the camera is installed, even when installed, there is a problem that an activity is limited 
by the image pick-up range of a camera. Therefore, this invention aims at offering the perimeter monitoring device for 
cars with which an operator shall tend to recognize the display sensuously according to the relation between a self-car 
and a perimeter situation, while image display of the situation of the perimeter of a car is carried out and concrete 
direction, distance, etc., such as an obstmction, are shown in view of the above-mentioned conventional trouble. 
[0005] 

[Means for Solving the Problem] For this reason, a perimeter detection means of a car by which this invention detects 
the situation of the perimeter of a car. An image composition means to compound the image showing the relative 
relation between a self-car and a perimeter in response to the signal from the perimeter detection means of a car, In the 
perimeter monitoring device for cars which comes to have a display means to provide an operator with a perimeter 
[ car ] situation in response to the signal from an image composition means an image composition means It shall have 
two display modes, the display which a perimeter is fixed and a self-car moves, and the display which fixes a self-car 
and a perimeter rotates, and shall h^^e"the'^fspte5»ssvw^ Corresponding to the 

distance of a self-car andtaiMob'S^gtion, a display switch means is protmded from the display rectangle of a self-car 
image, and can switcltaidi^splay mo^e^^ When starting the display 
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mode which a perimeter is fixed and a self-car moves further again, the display position of a self-car is shifted from a 

core, and the method opposite side of progress of a self-car can be displayed widely. 

[0006] 

[Function] Since it has ^S^i^^l^ffiodes with a switchable image composition means, the effectiveness that an 
operator tends to recognize relation with an obstruction etc. sensuously is acquired by switching the display mode 
according to the distance of a self-car and an obstruction etc. Moreover, operation becomes still easier when switching 
a display mode automatically according to a motion^of the^c^^^ time of parking, distance with an obstruction, the 
flash from a display rectangle, etc. And when starting the display mode which a perimeter is fixed and a self-car moves 
the travelling direction side of a self-car is displayed widely, the motor pool which it is going to stop enters in a display 
rectangle widely, and it becomes easy to form parking meter drawing. 
[0007] 

[Example] Hereafter, this invention is explained based on a drav^ng. Drawing 1 is the block diagram showing the 1st 
example of this invention. Two or more laser radar sensors 1 1 as a perimeter detection means of a car for detecting the 
situation of the perimeter of a car first on a car are formed in the comer of a car-body 10 order side, a side face, and 
four comers. While the signal from each da ser rad arsensorrl Hs4nputt into thmmmgm^mi^Mm^^^2^, the wheel 
speed sensor 13 and the steering angle se0sw44 are further connected to the image synthesizer unit 12. Drawing 2 
shows the layout on the car of the above-mentioned laser radar sensor 1 1 grade. The image synthesizer unit 12 
compounds the image in which the situation of a self-car and the perimeter of a car is shown while carrying out 
detection presumption of the location of a self-car by these in response to the signal of the wheel speed sensor 13 and 
the steering angle sensor 14. 

[0008] The storage 15 and the display 18 which can perform writing of image data and read-out are connected to the 
image synthesizer unit 12, and dispks^^fcfcjmdgi^ag^^^^^ and an input unit 17 are connected further. From 

the output of each sensor, display switch judging equipment 16 judges the distance of a self-car and an obstmction, and 
performs switch dkections-ofea'displaycmode as compared with the value set up beforehand. Moreover, as shown in 
drawing 3 , an input device 17 consists of two or more switch carbon buttons 19 arranged around an indicating 
equipment 1 8, and the input of it is attained in the direction of hope of an operator with the location of the operated 
switch carbon button. 

[0009] Drawing 4 is a flow chart which shows the flow of the processing in the above-mentioned configuration. First, 
the judgment of a display mode is performed by display switch judging equipment 16 in step 101, It starts from a 
perimeter revolution display mode immediately after start up of a system, or an operator is chosen by the switch 
switched to arbitration. In the case of a perimeter revolution display mode, it is step 102, and each laser radar sensor 
100 formed in the perimeter of a car body of a car performs sensing, and computes the distance of the each laser radar 
sensor 1 1 and the body pftheip^rrimetef^^^ concerned, and the distance-data obtained by each are sent to the imag< 
synthesizer unit 12. 

[0010] At step 103, in the image synthesizer unit 12, the configuration of the perimeter of a self-car is presumed and 
compositionjofg^ data of the above-mentioned peri^ieter of a car. Here, the 

graphic form of a self-car is first drawn in the center of the display .screen. Since it tums out beforehand in which 
location of a car each laser radar sensor 1 1 is installed, a body iTdrawn in the location of the display image which 
presumes the physical relationship of a car and an obstmction and corresponds from the location of each laser radar 
sensor 1 1, and the obtained distance data. An image as shown in drawing 5 is compounded by this, and it is stored in 
storage 15. 

[001 1] Next, at step 104, the above-mentioned^synthet ic4m 3g e"iS"Se nt:to:a:displaypl8. and display offer of the perimete 
situation is made towards an operator. It is square, and an enclose part to which a diagonal point is restored in a 
synthetic image, for example in drav^ng 5 as an example of a display is displayed as shown in (a) of drawing 6 . Lack 
of an indicative data does not arise in rotational transform in case this switches to the perimeter fixed display 
mentioned later. In (a) of drawing 6 , the self-car A is fixed in the center and Perimeter B carries out a migration 
revolution with migration of a self-car. It returns to step 101 after this. . 
[0012] From the next cycle after the first display was made, disphy^sv^tch:judging 

djsplayjmode according t03 motieg^^ at the time of parking. That is, the cut of a steering is 

performed when it is going to retreat once a car advances from width to a parking space and goes past, and it is going t( 
put into a parking space. When Ais-cutisji etecte d by the signal of the^teering angleisensoR 14, it is made the display 
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mode of-perimeter 11^ In addition, when a parking space is able to be presumed from the perimeter 

configuration acquired between perimeter revolution display modes, it is good also as what is switched to the display 
mode of perimeter immobilization centering on the presumed parking space. 

[0013] In a ****** case, the judgment of a display mode progresses to perimeter-fixedjntKie at step 105, and rotational 
transform of a synthetic image is performed- Here, it inputs by pushing the switch carbon button of the location 
corresponding to a display screen in which part of the image with which the operator is displayed for you to fix caudad 
and to want to display using the input unit 17 which consists of two or more switch carbon buttons 19 arranged around 
an indicating equipment 18. Being able to fix the display of a perimeter situation in the direction at which it is easy to 
park an operator by this, the display after rotational transform becomes as shown in (b) of drawing 6 . 
[0014] Subsequentiy, at step 106, after storing the above-mentioned image after conversion in storage 15, in step 107, i 
motion of a self-car is detected from the wheel speed sensor 13 and the steering angle sensor 14, and a self-vehicle 
location is presumed by dead REKONINGU etc. based on this with the image synthesizer unit 12. Next, at step 108, 
sensing of distance witfi the body by the laser radar sensor 1 1 of a self-car is performed. 
[0015] And in step 109, with the image synthesizer unit 12, relative relation with the perimeter [ car ] situation 
remembered to be the self-vehicle location presumed previously is collated, and amendment of a self-vehicle display 
position is performed. Since a self-vehicle location will change and also changes the detection range by the laser radar 
sensor 1 1 while this fixes the image of a perimeter situation, as compared with the image which is in storage 15 about z 
detection result, effect of the presumed error of a car location is made small. 

[0016] At step 1 10, the criteria distance set up beforehand is checked for the distance between the detected car and a 
perimeter obstruction in display switch judging equipment 16 after this, when distance becomes short rather than 
criteria distance, while being switched to the perimeter revolution display mode which it progresses to step 120, a car i* 
fixed in the center, and a perimeter rotates ~ (d) of drawing 6 ~ it expands like and is displayed. Step 107 or 
subsequent ones is repeated after this. And if a car moves and the distance from an obstruction becomes larger than 
criteria distance, the check in step 110 will change to a perimeter fixed display mode again. 

[0017] Since a self-car may overflow the display rectangle when it considers as the display which the location of a self 
car moves with a perimeter fixed display mode, at the following step 1 1 1, it is confirmed whether the car has 
overflowed the display rectangle of the synthetic image with which display switch judging equipment 16 was 
memorized. In addition, if conditions in case a body is in less than 50cm from the car part protruded from the display 
rectangle are established when it is in charge of the judgment of the flash from a display rectangle, for example, 1/3 or 
more [ of a self-car ] comes outside a display rectangle or, a switch of a frequent screen will be avoided. , , 

[0018] When the car has overflowed here, a perimeter fixed display mode is canceled and it progresses to step 102 as a 
perimeter revolution display mode. Under the present circumstances, the sign of a display-mode change can be 
simultaneously sent to an operator. In addition, if close comes in a display rectangle, you may make it a self-vehicle 
location switch to a perimeter fixed display mode automatically again in the mode judging of step 101, even when a 
self-car becomes a flash and a perimeter revolution display mode from a display rectangle in this way. It becomes 
unnecessary to make an operator do excessive actuation. 

[0019] With the check of step 1 1 1, when there is no flash of a car, image composition which is step 1 12 and set the 
self-car in the image synthesizer unit 12 in the location which erases the self-car in the synthetic image memorized at 
previous step 106, and newly on an image corresponds is performed. And it expresses to a display 230 as step 1 13, and 
an operator is provided with the perimeter situation of a self-car. Thereby, as shown in (c) of dravying 6 , it considers as 
the display to which a self-car moves the inside of the fixed perimeter image, and a motion of a car can be grasped 
intuitively. It returns to step 107 after this. 

[0020] Step 101 and steps 107-111 constitute the display^witch^^^ respectively, and especially the 

steps 107-109 of them constitute the self-vehicle location detection means. In addition, as a perimeter detection means 
of a car, it does not restrict to a laser radar sensor and it cannot be overemphasized that the thing using a supersonic 
wave and an electric wave may be used. Moreover, from a fixed display, as mentioned above, an operator's switch 
input by detection of the flash of the car from a display rectangle etc. may usually be made to perform the switch to a 
display. In addition, although many laser radar sensors shall be installed in the perimeter of a car body in the above- 
mentioned example, it is more good for high degree of accuracy to enable it to detect the configuration of the perimetei 
of a car by scanning and detecting this using the sensor from which not only this but the detection field was extracted. 
[0021] The 2nd example of drawing 7 and this invention is shov^. Q^c amera is used:fo r:this:as:a:perimeten 
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detection means of a self-car. T^oTor^mpre cameras 21- w photo the situatiolCofJth'e:^^ first 
installed m ear-bodjrorder and a:right^and4e^boA-sid^^^^ by:the:car:10. While the signal from each camera 21 is 
inputted into the image synthesizer unit 22> the wheel speed sensor 13 and the steering angle sensor 14 are connected tc 
the image synthesizer unit 22 as well as the before example. Drawing 8 shows the layout on the car of the above- 
mentioned camera 21 grade. The image synthesizer unit 22 carries out transparent transformation of the image from 
each camera 21, and compounds it in the image of one sheet which displays the perimeter of a car. Other configuration: 
are the same as the 1 st example, 

[0022] Drawing 9 is a flow chart which shows the flow of the processing in this example. In step 201, the judgment of 
a display mode is first performed by display^^swjtch judging e^^ 16. It is step 202, and in the case of a perimeter 

revolution display mode, the situation of the perimeter of a car is photoed with each camera 21, and transparent 
transformation of the image from the camera is performed at step 203, and it is compounded^y^theimagej^fTiGrie-^^ 
[0023] And at the following step 204, the above-mentioned synthetic image is sent to a display 18, and display offer of 
the perimeter situation is made towards an operator. That is, it asks for distance data with the body of the perimeter of J 
car by the laser radar sensor at step 102 of the flow chart shown in drawing 4 of a before example, and the point of 
using the transparent transformation of camera photography and an image is different by this example to composition 
of an image being performed at step 103 based on this. 

[0024] On the other hand, when judged wiA a perinieter at step 201, like a before example, 

rotational transform of an image is performed ^at step^ 205, and the image after conversion is stored in storage 15 at step 
206. And in step 207, the image synthesizer unit 22 detects a motion of a self-car from th e ^wheel speed sensor 13 and 
the gteeringangle sensor 14, and a self-vehicle location is presumed based on this. At the following step 208, the self- 
vehicle location which carried out [ above-mentioned ] presumption with the image memorized at step 206 is collated, 
and amendment of a self-vehicle display position is performed. At step 209, this judgment of the.flash e?dste^ from 
the display rectangle of a self-car by which location amendment was carried out is performed. 
[0025] When a display rectangle is not overflowed, in step 210, a self-car is compounded in piles in the image by 
which storage was carried out [ above-mentioned ], and it expresses to a display 18 as step 211. The display which a 
self-car moves by this in the inside of the image with which the perimeter was fixed is obtained. It returns to step 207 
after this. Moreover, when the self-car has overflowed the display rectangle, a perimeter fixed display mode is cancelec 
and it progresses to step 202 as a perimeter revolution display mode. 

[0026] Step 201 and steps 207-209 constitute the display switch means of invention, and especially the steps 207-208 
of them constitute the self-vehicle location detection means. Like a before example, according to the relation between 
self-** and a perimeter situatio n, a:perimeter reyo l utjoiv^spla ^ and a pgrim eter fix o lidis^ are switched 

<byjhisiexample, and it has according to it the effectiveness that an operator ten3slo"fecogfnze relatiOTwith an 
obstruction etc. sensuously. 

[0027] Next, the 3rd example is explained. When the tr avelling directio n ofa^f-car is detected and it goes into 
perimeter fixed mode, this uses the display position of a self-car as an edge, and is made to give an indication around a 
travelling direction large based on the 1st example by the newly formed gear positij; )njensor_besides the steering a ngle 
sensor 14 and the wheg Lspeed sensor 13. That is, although not illustrated especially, the gear position sensor is further 
connected to the image synthesizer unit 12, and other connection relation is the same as the thing of drawing 1 . 
[0028] Drawing 10 and drawing 1 1 show the flow of display processing in this 3rd example, give the same number as 
drawing 4 to the step which performs the same processing as the 1st example, and omit explanation. ******** is first 
judged immediately after going into perimeter fixed mode at step 301 after self-vehicle location presumption of step 
107. In the next case, it progresses to step 302 and the travelling direction of a self-car is detected. Here, an exact 
travelling direction is called for by the steering angle sensor 14 and the gear position sensor. In addition, it sets to 
restrict, and if it is only distinction of advance or retreat even if an exact travelling direction is known and it is not 
moving, also when [ which detect the revolution difference of a wheel on either side using the wheel speed sensor 13 ] 
the car is moving, it is detectable only by the gear position sensor. The above-mentioned step 302 constitutes the 
travelling direction detection means of invention. 

[0029] Next, at step 303, the display initial position of a self-car is decided to be the location which the perimeter of a 
travelling direction can display widely. Then, it progresses to sensing. around [ car ] step 108. And it shifts and goes 
from the fixed initial position as a self-car moves by. passing steps 302 and 303 and progressing to step 108 from the 
direct step 301, when it is notimmediately aftei:going.into4iie_2nd. routine or subsequent ones, i.e., perimeter fixed 
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mode. Since the situation around a travellmgdirectio^ is widely displayed when iteoes into perimeter fixed mode by 
carrying out like this, the plan of paricing and the operation plan [ on a narrow pa3i]"oFpassi5gTlT^^ very 
easy. 

[0030] It is also further applicable as the 4th example to give an indication around a travelling direction large as 
mentioned above based on the 2nd example. Although not especially illustrated in this case, addition connection of the 
gear position sensor is made at the image synthesizer unit 22, and the travelling direction of a self-car is detected. Othe 
connection relation is the same as the thing of drawing 7 . Drawing 12 and drawing 13 show the flow of display 
processing in this 4th example. The same number as drawing 9 is given to the step which performs the same processing 
as the 2nd example. And at steps 401-403 inserted among steps 207 and 208, the same processing as steps 301-303 in 
drawing 1 1 of a before example is performed. Since the situation around a travelling direction is widely displayed by 
this when it goes into perimeter fixed mode, the plan of parking and the operation plan [ on a narrow path ] of passing 
through are formed easily similarly. 
[0031] 

[Effect of the Invention] In the perimeter monitoring device for cars which displays the image which compounded this 
invention based on the signal from the perimeter detection means of a car as above Since it has two display modes, the 
display which a perimeter is fixed and a self-car moves, and the display which fixes a self-car and a perimeter rotates, 
and the switch of each display mode was enabled It has the effectiveness that an operator tends to recognize relation 
with an obstruction etc. sensuously, by switching according to the distance of a self-car and an obstmction at the time 
of parking to a parking space etc. Moreover, when detecting a motion of the car at the time of parking, distance with an 
obstruction, the flash from a display rectangle, etc. and switching a display mode automatically, there is effectiveness ii 
is ineffective to operation being still easier. 



[Translation done.] 
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* NOTICES * 



Japan Patent Office is not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the original precisely. 

2. **** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 
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